A Verbal Interaction Measure Using Acoustic Signal Correlation for Dyadic Cooperation Support

نویسندگان

  • Alexander Neumann
  • Thomas Hermann
چکیده

We introduce a method for detecting whether two users are engaged in focused interaction using a windowed correlation measure on their acoustic signals, assuming that a continued exchange of verbal turns contributes to anticorrelation of acoustic activity. We tested our method with manually annotated transitions between focused and unfocused interaction stemming from experiments on AR-based cooperation within a research project on alignment in communication. The results show that a high degree and extended duration of speech activity anticorrelation reliably indicates focused interaction, and might thus be a valuable asset for situation-aware technical systems.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Comparative Study of Gender and Age Classification in Speech Signals

Accurate gender classification is useful in speech and speaker recognition as well as speech emotion classification, because a better performance has been reported when separate acoustic models are employed for males and females. Gender classification is also apparent in face recognition, video summarization, human-robot interaction, etc. Although gender classification is rather mature in a...

متن کامل

Using Informal Conversation in the Clinical Setting as a Measure of Communication Potential for Adults with Aphasia

The purpose of this study was to investigate the clinical usefulness of informal conversation as a tool for determining ability to communicate potential regardless of modality (verbal or nonverbal). Four individuals with aphasia (two non-fluent and two fluent) and four non-impaired individuals participated in this study. Selected segments of conversational discourse were analyzed for communicat...

متن کامل

Acoustic correlated sources direction finding in the presence of unknown spatial correlation noise

In this paper, a new method is proposed for DOA estimation of correlated acoustic signals, in the presence of unknown spatial correlation noise. By generating a matrix from the signal subspace with the Hankel-SVD method, the correlated resource information is extracted from each eigen-vector. Then a joint-diagonalization  structure is constructed of the signal subspace and basis it, independent...

متن کامل

The Language of Interpersonal Interaction: An Interdisciplinary Approach to Assessing and Processing Vocal and Speech Data

Verbal and non-verbal information are central to social interaction between humans, and have been studied intensively in psychology. Especially, dyadic interaction settings (e.g, between romantic partners or between psychotherapist and patient) are relevant for a number of psychological research areas. However, psychological methods applied so far have not been able to handle the vast amount of...

متن کامل

Multimodal Cognitive Nonverbal and Verbal Interactions: the Neurorehabilitation of Autistic Children Via Mobile Toy Robots

Multimodal cognitive nonverbal processes could be thought as a building block from which emotional and verbal expressions could emerge. With the intention to explore this hypothesis, we studied the interaction between autistic children and mobile toy robots during free spontaneous game play both quantitatively and qualitatively. Cognitive nonverbal criteria (eye contact, touch, manipulation, an...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013